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Abstract 

Design  of  autonomous  underwater  robots  is  particularly 
difficult  due  to  the  physical  and  sensor  challenges  of 
the  underwater  environment.  Inaccessibility  during 
operation  and  low  probability  of  failure  recovery  makes 
robot  stability  and  reliability  paramount.  Building  an 
accurate  and  complete  virtual  world  simulation  is 
proposed  as  a  necessary  prerequisite  for  design  of  an 
autonomous  underwater  robot.  A  virtual  world  can 
include  actual  robot  components  and  models  fa*  all 
other  aspects  of  the  world.  Robot  design  can  be  fully 
tested  using  a  virtual  world  and  then  verified  using  the 
real  world.  Additional  testing  can  be  performed  in  the 
virtual  world  that  is  not  feasible  in  the  real  world. 
Visualization  of  robot  interactions  within  a  virtual  world 
permits  sophisticated  analysis  of  robot  performance  that 
is  otherwise  unavailable.  All  aspects  of  world  modeling 
and  robot  design  must  be  mastered  and  coordinated  in 
order  to  build  an  authentic  virtual  world  and  capable 
autonomous  robot. 

1  Problems 

Autonomous  underwater  robot  design  is  difficult. 
Unlike  most  other  mobile  robots,  underwater  robots 
must  operate  imattended  and  unctxitrolled  in  a  remote 
and  unforgiving  environment.  Inaccessibility  during 
operation  greatly  complicates  the  design  and  evaluation 
system  software.  In  order  to  ensure  complete 
reliability,  however,  robot  software  and  hardware  need 
to  be  fully  tested  in  a  controlled  environment  before 
q)erational  deployment.  Such  comprehensive  testing 
requirements  cannot  be  met  using  a  standalone 
laborattHy  robot  due  to  the  complexity  and 
unpredictability  of  interactions  that  can  occur  in  the 
actual  remote  environment.  A  different  approach  is 
needed  which  can  effectively  support  research  on  the 
many  problems  facing  underwater  robot  designers. 

Underwater  robots  are  normally  termed 
autonomous  underwater  vehicles  (AUVs),  not  because 
they  are  intended  to  carry  people  but  rather  because 
they  are  designed  to  intelligently  convey  sensors  and 
payloads.  AUVs  must  accomplish  complex  tasks  and 
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diverse  missims  while  maintaining  physical 

control  with  six  spatial  degrees  of  freedom.  Little  or  no 
communication  with  distant  human  supervisors  is 
possible.  When  compared  to  indoor,  ground,  airborne 
or  space  environments,  the  underwater  domain  typically 
imposes  the  most  restrictive  physical  control  and  sensor 
limitations  upon  a  robot.  Underwater  robot  design 
requirements  therefore  motivate  this  examination. 
Considerations  and  conclusions  remain  pertinent  as 
worst-case  examples  in  other  environments. 

A  large  gap  exists  between  the  projections  of 
theory  and  the  actual  practice  of  underwater  robot 
design.  Despite  a  large  number  of  remotely  operated 
submersibles  and  a  rich  field  of  autonomous  robot 
research  results  (Iyengar  and  Elfes  1990a.  1990b).  few 
AUVs  exist  and  their  capabilities  are  limited.  Cost, 
inaccessibility  and  scope  of  AUV  design  restrict  the 
number  and  reach  of  players  involved.  Interacticms  and 
interdependencies  between  hardware  and  software 
component  problems  are  poorly  understood.  Testing  is 
difficult,  tedious,  infrequent  and  potentially  bazardo”S. 
Meaningful  evaluation  of  results  is  hampered  by  overall 
problem  complexity,  sensor  inadequacies  and  human 
inability  to  directly  observe  the  robot  in  situ.  Potential 
loss  of  an  autonomous  underwater  robot  is  generally 
intolerable  due  to  tremendous  investment  in  time  and 
resources,  likelihood  that  any  failure  will  beccxne 
catastrophic  and  difficulty  of  recovery. 

Underwater  robot  progress  has  been  slow  and 
painstaking  for  many  reasons.  By  necessity  most 
research  is  performed  piecemeal  and  incrementally.  For 
example,  a  narrow  problem  might  be  identified  as 
suitable  for  solution  by  a  particular  artificial 
intelligence  (AI)  paradigm  and  examined  in  great  detail. 
Conjectures  and  theories  are  used  to  create  an 
implementation  which  is  tested  by  building  a  model  or 
simulation  specifically  suited  to  the  problem  in 
questioa  Test  success  or  failure  is  used  to  interpret 
validity  of  conclusions.  Unfortunately,  integration  of 
the  design  process  or  even  final  results  aio  a  working 
robot  is  often  difficult  or  impossible.  Lack  of 
integrated  testing  prevents  complete  verification  of 
conclusions. 

AUV  design  must  provide  autonomy,  stability 
and  reliability  with  little  toleraix;e  for  error.  Control 
systems  require  particular  attentioi  since  closed-form 
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solutions  for  many  hydrodynamics  control  issues  are 
unknown.  In  addition,  AI  methodologies  are  essential 
fcM:  many  critical  robot  software  components,  but  the 
interaction  complexity  and  emergent  behavior  of 
multiple  interacting  AI  processes  is  poorly  understood, 
rarely  tested  and  impossible  to  ftxmally  specify.  Better 
approaches  are  needed  to  support  coordinated  research, 
design  and  implementation  of  underwater  robots. 

Despite  these  many  handicaps,  the  numerous 
challenges  of  operating  in  the  underwater  environment 
force  designers  to  build  robots  that  are  truly  robust, 
autonomous,  mobile  and  stable.  This  fits  well  with  a 
motivating  philosophy  trf  Hans  Moravec:  "..  solving 
the  day  to  day  problems  of  developing  a  mobile 
organism  steers  one  in  the  direction  of  general 
intelligence...  Mobile  robotics  may  or  may  not  be  the 
fastest  way  to  arrive  at  general  human  conpetence  in 
machines,  but  I  believe  it  is  one  of  the  surest 
roads."  (Moravec  1983) 

2  Multiple  Interacting  Processes 

Designing  an  AUV  is  complex.  Many  capabilities  are 
required  for  an  underwater  mobile  robot  to  act  capably 
and  independently.  Stable  physical  control,  motitxi 
control,  sensing,  motion  planning,  mission  planning, 
replanning  and  failure  recovery  are  example  software 
components  that  must  be  solved  individually  for 
tractability.  The  diversity  and  dissimilarity  of  these 
many  component  subproblems  precludes  use  of  a  single 
mcnolithic  AI  paradigm. 

Distributed  AI  usually  addresses  specifications 
and  protocols  between  similar  autoncxnous  agents 
working  cooperatively  on  global  problems.  Hybrid 
reasoiung  often  refers  to  novel  combinations  of  two  or 
three  teclmiques  to  improve  overall  performance  when 
solving  a  single  problem  type.  Neither  definiticn 
appears  suitable  for  general  robot  control.  Multiple 
dissimilar  AI  processes  must  interact  in  an  intelligent 
manner  to  achieve  the  robust  capabilities  and  multiple 
behaviors  needed  by  a  mobile  robot  (Elfes  1986).  A 
variety  robot  architectures  have  been  proposed  and 
developed  to  provide  the  control  framework  under 
which  multiple  AI  processes  can  interact.  A  brief 
discussion  of  current  robot  architectures  is  therefore 
useful  to  clarify  the  scope  of  robot  design  issues. 

Robot  architectures  can  be  classified  over  a 
spectrum  that  ranges  from  hierarchical  to  reactive 
(Byrnes  et  al.  1992).  Hierarchical  architectures  are 
deliberative,  symbolic,  structured,  "top  down," 
goal-driven,  have  explicit  focus  of  attention  and  are 
often  implemented  using  backward  inferencing. 
Hierarchical  approaches  typically  contain  world  models 
and  use  planning  and  search  techniques  to  achieve 
strictly  defined  goals.  Hi^archical  architectures  tend  to 
be  scmewhat  rigid,  unresponsive  in  unpredicted 
situations  and  computatioa-intensive,  yet  remain  capable 
of  highly  sophisticated  performance. 


Reactive  architectures  are  subsumptive, 
"bottom  up."  sensor-driven,  layered  and  may  often  be 
characterized  by  forward  inferencing.  Reactive 
architectures  attempt  to  combine  robust  subsuming 
behaviors  while  avoiding  dynamic  planning  and  world 
models.  Reactive  architectures  appear  to  behave 
somewhat  randomly  and  achieve  success  without 
massive  computations  by  using  well-considered 
behaviors  that  tend  to  lead  to  task  completion 
(Brooks  1986).  Scaling  up  to  complex  missions  is 
difficult.  Stability  and  deterministic  performance  is 
elusive. 

It  is  interesting  to  note  that  numerous  robot 
architecture  researchers  have  recently  proposed  hybrid 
control  architectures  (Kwak  et  al.  1992)  (Bonasso  et  al. 
1992)  (Bellingham  and  Consi  1990)  (Payton  and  Bihari 
1991)  (Spector  and  Hendler  1991).  A  common  theme 
in  these  proposals  is  integrating  the  Img-term 
deliberation,  planning  and  state  information  found  in 
hierarchical  approaches  with  the  quick  reaction  and 
adaptability  of  subsumptive  behaviors.  Individual 
weaknesses  of  hierarchical  and  reactive  architectures 
appear  to  be  well-balanced  by  their  respective  strengths. 

Stability  and  reliability  deserve  repeated  mention 
in  the  context  of  multiple  interacting  processes.  Control 
system  considerations  are  often  overloc^ed  under  the 
guise  of  simplifying  assumptions  that  hide  important 
real  world  restrictions  and  pitfalls.  Robot  survivability 
dictates  that  physical  and  logical  behavior  must  always 
converge  to  a  stable  yet  adaptive  set  of  states. 
Divergence,  deadlock,  infinite  loops  and  non-linear 
dynamic  behavicx  must  be  detectable  and  controllable. 
Real-time  operating  constraints  on  sensing,  processing, 
action  and  reaction  must  be  similarly  resolved. 
Stability  prerequisites  become  similarly  important  for 
ground  robots  as  they  progress  from  structured  to 
unrestricted  environments. 


3  Virtual  World 


The  broad  requirements  of  underwater  robot  design 
provide  a  strong  argument  against  piecemeal  design 
verification.  Individual  component  simulations  are  not 
adequate  to  develop  effective  Al-based  systems  or 
evaluate  overall  robot  performance. 

Virtual  wwld  systems  provide  the  capability  to 
see  and  interact  with  distant,  expensive,  hazardous  or 
non-existent  three-dimensional  environments  (Zyda  and 
Pratt  1992).  A  virtual  wcxld  is  intended  to  provide 
complete  functionality  of  the  target  environment  in  the 
laboratory.  A  virtual  world  can  provide  adequate 
simulatim  scope  and  interaction  capability  to  overcome 
the  inherent  design  handicaps  imposed  when  building  a 
remote  robot  to  operate  in  a  hazardous  environment. 
Construction  of  a  virtual  world  for  robot  development 
and  evaluation  is  hereby  proposed  as  a  necessary 
prerequisite  for  successful  design  of  a  complex  remote 
lobol  such  as  <ui  ADV.  i  i 
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A  virtual  world  which  is  used  to  recreate  every 
aspect  of  the  environment  external  to  the  robot  must 
also  include  robot  sensors  and  analog  devices  (such  as 
thrusters  and  rudders)  which  are  impossible  to 
realistically  operate  in  a  laboratory.  Interactions 
between  software  processes,  vehicle  hardware  and  the 
real  world  must  all  be  comprehensively  modeled  and 
mutually  consistent.  Robot  physical  behavior  and 
sensor  interactions  must  be  adequately  simulated.  The 
robot  itself  is  directly  plugged  into  the  virtual  world 
using  normal  sensor  and  actuator  connections.  The 
difference  between  operation  in  a  virtual  w(»ld  or  an 
actual  environment  must  be  transparent  to  the  robot  in 
order  to  be  effective.  Successful  implementation  of  the 
virtual  world  can  be  validated  by  identical  robot 
performance  in  each  domain. 

The  potential  value  of  general  world  simulators 
has  been  previously  recognized  (Moravec  1988). 
Certain  underwater  robots  already  benefit  from  the 
availability  of  capable  simulators  (Pappas  et  al.  1991) 
(Brutzman  1992a)  (Brutzman  et  al.  lW2b).  However, 
once  simulation  sophistication  reaches  that  of  a  virtual 
world,  interesting  things  become  iKissible.  Emergent 
behavior  from  interaction  between  multiple  Al 
processes  and  the  environment  becomes  evident. 
Sensor  interactions  can  be  repeated  indefinitely  in  order 
to  develop  new  analysis  algorithms  and  achieve 
fine-tuned  sensor  performance.  Machine  learning  based 
on  massive  repetitive  training  becomes  feasible  and  can 
be  conveniently  monitored.  Potentially  fatal  scenarios 
can  be  attempted  without  risk  to  robot,  human  rx- 
environment. 

A  plethora  of  interrelated  requirements  requires 
mastering  all  aspects  of  world  modeling  and  robot 
design  in  order  to  birild  both  an  authentic  virtual  world 
and  a  capable  autonomous  robot.  Traditionally  only 
component  software  processes  were  integrated  into  the 
robot  architecture;  now  corresponding  validaticm 
simulations  must  also  be  integrated  into  the  virtual 
world.  Adequate  simulation  of  a  comprehensive 
imderwater  virtual  world  is  possible  since  precise 
models  are  available  for  kinematics  (Badler  et  al.  1991) 
(Zyda  et  al.  1991)  (Zyda  et  al.  1990),  hydrodynamics 
(Yuh  1990)  (Abkowitz  1%9),  sonar  response  (Etter 
1991),  and  other  objects  in  the  underwater  environment 
(Pentland  1990).  Characteristics  of  the  underwater 
vehicle  physical  components  which  require  modeling 
can  be  handled  on  a  case  basis  (Pappas  IS^l). 
Depending  uptm  planned  missions  and  AUV  hull  fcxm, 
interactive  terrain  modeling  (Pratt  et  al.  1992)  and 
precise  hydrodynamics  modeling  are  areas  likely  to 
require  further  investigat'oa  prior  to  implementation. 
Virtual  world  construction  requires  significant 
coordinatitm  and  cross-disciplinary  efrorts. 

From  a  design  viewpoint,  models  replace 
functitmlity  otherwise  found  only  in  the  real  wiald. 
Identical  replication  of  every  world  characteristic  is 


impossible  but  partial  modeling  of  all  pertinent  world 
aspects  is  necessary.  Exact  reproduction  of  real  world 
behavior  might  even  be  undesirable  in  some  cases.  For 
example,  a  sonar  model  might  provide  perfect  range 
and  intensity  values  that  can  be  augmented  by 
statistically  adjustable  noise  and  errors.  Initial  training 
or  evaluation  of  a  new  sensor  algorithm  is  best 
performed  using  the  "perfect"  error-free  model.  Further 
analysis  using  quantifiable  noise  and  errors  will  provide 
new  insight  into  algorithm  robustness  and  adaptability. 
Because  it  has  been  coupled  with  the  robot’s  ability  to 
move  freely  throughout  a  virtual  world,  overall 
effectiveness  of  this  example  Al-based  sensor  process 
is  likely  to  be  superior  to  that  obtainable  by  training  in 
the  real  world. 

Models  in  virtual  worlds  can  be  further  studied 
to  examine  the  benefits  of  controllable  error  precision, 
addition  of  uncertainty,  incorporation  and  extension  of 
actual  sensor  data,  and  maintaining  internal  world 
consistency  throughout  mutual  interacticHis  between 
individual  component  models  and  the  multifaceted 
autonomous  robot.  Such  study  also  clarifies 
understanding  of  robot  design  problems  and 
specifications. 

4  Visualization 

A  robot  interacting  wiihin  a  virtual  world  permits 
complete  visualization  of  all  aspects  of  both  robot  and 
virtual  environment.  Visualization  of  robot 
performance  is  essential  for  evaluating  both  the  precise 
details  of  low-level  execution  and  the  broad  suitability 
of  high-level  behaviors.  Visualization  of  robot 
interactions  permits  sophisticated  analysis  that  is  not 
possible  using  traditicnal  test  methods  such  as 
individual  software  module  evaluation,  direct  robot 
observation  or  post-mission  reconstruction. 

Human  beings  are  visually  oriented.  Being  able 
to  see  and  control  location  and  time  in  a  moviog  picture 
allows  us  to  quickly  and  intuitively  understand  data  sets 
of  much  higher  dimensionality  than  is  otherwise 
possible.  Scientific  visualization  of  a  robot  in  its 
surroundings  can  greatly  improve  our  comprehension  of 
what  is  really  going  on.  Being  able  to  "look"  over  a 
robot’s  shoulder  or  "see"  through  a  robot’s  sensors 
provides  completely  new  perspectives.  Addition  of 
aural  cues  provides  a  further  order-of-magnitude 
increase  in  perceptual  bandwidth.  Visualization 
techniques  greatly  improve  the  effectiveness  of  complex 
Al  process  design  and  development,  and  can  even 
enable  successful  Al-based  applications  that  might 
otherwise  be  infeasible  (Brutzman  et  al.  1992c). 

5  Implementation 

Constructing  a  virtual  world  and  designing  an 
autonomous  underwater  robot  are  big  jobs.  This  section 
outlines  some  design  considerations  for  implementing 
them  in  combination. 
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You’ve  got  to  get  your  arms  around  the  world! 
A  robot  development  team  has  to  understand  the 
fundamental  basis  of  every  virtual  world  component 
and  every  robot  component.  All  efforts  must  be 
considered  in  relation  to  the  virtual  world  models  and 
overall  robot  architecture.  Most  research  results  are 
partial  and  developed  in  isolation,  which  may  be  why 
current  autonanous  robots  rarely  achieve  a  level  al 
performance  that  can  be  considered  intelligent.  The 
many  details  of  world  modeling  and  robot  design  must 
be  addressed  in  a  comprehensive,  coordinated  maimer 
or  the  overall  problem  remains  unbounded. 

A  virtual  world  ought  to  include  interfaces  for 
the  actual  robot  or  have  duplicate  robot  processing 
hardware  directly  connected.  As  mentioned  previouslv. 
which  environment  is  active  should  not  be  evident  to 
the  robot.  If  robot  behavior  is  affected  by  substitution 
of  a  virtual  world  for  the  actual  world  then  laboratory 
results  become  suspect  Reverification  of  laboratory 
results  in  the  real  world  due  to  inadequacies  in  the 
virtual  world  will  be  time-consuming,  ambiguous  and 
possibly  contradictoy.  Identical  robot  performance  in 
each  domain  allows  development  of  a  single  version  of 
robot  software,  a  valuable  software  engineering 
consideration. 

Virtual  world  simulation  and  visualization 
graphics  rendering  are  computaticaially  expensive.  A 
distributed  implementation  can  solve  real-time 
processing  bottlenecks  by  exploiting  the  implicit 
parallelism  that  is  available  over  networked 
workstations.  A  distributed  approach  also  permits  rapid 
access  to  multiple  versions  of  robot  control  software 
and  addition  of  an  indefinite  number  of  virtual  robots 
into  the  virtual  wcvld.  A  side  benefit  of  a  networked 
implementation  is  accessibility  for  remote  research. 
The  theoretical  basis  and  construction  of  virtual  worlds 
remains  an  area  of  active  investigation  (Rbeingold 
1991). 

Theory  will  continue  to  outstrip  the  practice  of 
autonomems  imderwater  robotics  unless  improved 
design  methodologies  are  employed.  Overall  problem 
complexity  and  the  importance  of  emergent  behavicx 
dictate  that  actual  robot  implementations  need  to  be 
used  to  confirm  broad  theoretical  conclusicxis. 

Many  of  the  conclusions  reached  in  this  paper 
are  based  on  work  accomplished  with  the  Naval 
Postgraduate  School  AUV  (Healey  et  al.  1992) 
(Brutzman  and  Compton  1991).  Using  an  actual  robot 
with  measurable  performance  greatly  clarifies  research 
ctmclusions.  Btiilding  a  virtual  world  that  matches  the 
envirenm^t  used  by  an  actual  robot  is  expected  to 
accelerate  robotic  research  progress  and  provide 
credible,  verifiable  results. 


6  Conclusions 

Use  of  a  virtual  world  can  greatly  improve  development 
of  multiple  interacting  Al-based  processes  that  are  the 
critical  components  of  autonomous  underwater  robots. 
ConsUnction  of  an  underwater  virtual  world  is  feasible. 
Scientific  visualization  of  robot  interactions  in  a  virtual 
world  can  improve  our  perceptual  capabilities  by 
several  orders  of  magnitude,  enabling  more  effective 
research  progress.  Every  aspect  of  virtual  world  and 
autonomous  robot  design  must  be  considered  and 
implemented  in  a  coordinated  maimer. 
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